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About NCSRP and Hopes , Fears , £s? Reality 

T he University ofWashington’s National Charter School Research 
Project aims to bring rigor, evidence, and balance to the national 
charter school debate. Its goals are to i) facilitate the fair assess- 
ment of the value-added effects of U.S. charter schools, and 2) provide the charter 
school and broader public education communities with research and information 
for ongoing improvement. 

Hopes, Fears, & Reality is the first publication from NCSRP. This report will be 
published annually and will explore controversial, developing, or pressing charter 
school issues. NCSRP intends to identify the root causes, illuminate complexities, 
and move beyond polemics to elevate the level of the discussion around each prob- 
lem, without making specific arguments for or against any position in the debate. 
NCSRP hopes that this report will be useful to charter school advocates, skeptics, 
and people curious about this new form of public education. 

For more information and research on charter schools, please visit the NCSRP 
website atwww.crpe.org/ncsrp. Original research, state-by-state charter school 
data, links to charter school research by other groups, and more can be found there. 
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T he 2004-2005 school year was a banner year for charter schools. First 

launched 1 5 years ago in Minnesota, the charter phenomenon had spread 
to 40 states and Washington, D.C. By September 2004 almost one mil- 
lion children were enrolled in 3,300 charter schools. Buoyed by national 
the Clinton administration in the 1990s, charter schools received an 
additional shot-in-the-arm with endorsement as alternatives for 
traditional public schools failing to make satisfactory progress under 
the Bush administration’s No Child Left Behind legislation. 

The 2004-2005 school year was also a tumultuous one for charter 
schools. Though the number of charter schools continued to grow 
and increasing numbers of parents wanted to enroll their children, 
charter school supporters found themselves on the defensive. They 
were forced to defend the claim that formed the basis of their funda- 
mental contract: in return for freedom from bureaucratic constraints, 
charter schools would improve student achievement. In the second 
half of 2004, studies based on data assembled by the U.S. Department 
of Education’s National Center on Education Statistics (NCES) 
concluded that there was no appreciable difference in reading perfor- 
mance between charter school students and students in traditional 
public schools. 1 The American Federation of Teachers (AFT) issued 
a report in August 2004 using the NCES data and argued that charter 
schools had been tested and were found wanting when held to the same 
standards as traditional schools. Under political pressure to release its 
results, NCES later issued a report drawing similar conclusions. 

Thus ensued what has become known as the charter school “dustup,”in which some 
researchers cited the NCES data and AFT study as proof that charter schools were not 
working, and others argued that the data could not support the conclusions being drawn 
from it. Pro-charter researchers also issued very different studies drawing conclusions 
opposite from the AFT’s. Some national newspapers took sides on editorial pages, esca- 
lating the dispute. 



support from 

; WHAT ARE CHARTER SCHOOLS? 

Charter schools are public schools of 
choice. Charter schools receive public 
funds based on the number of children 
who attend, and schools that do not attract 
enough students to pay their bills must 
close. Schools obtain charters only with 
the approval and oversight of their local 
school district or other state agency. The 
approving agency can also close a charter 
school if it does not perform. The adults 
who run charter schools and teach in them 
enjoy significant freedom of action, but 
they can lose their jobs if the school proves 
ineffective or families do not choose it. 

Charter schools are another way— in 
addition to schools directly operated by 
a school district— that communities can 
create new public education options and 
partnerships for their children. While 
some of public education’s traditional 
constituents may be uncomfortable with 
charter schools, these new institutions are 
intended to be part of the fabric of public 
life in their communities. 
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Even before the dustup occurred, several foundations that had supported the creation of 
charter schools decided that the research on charter schools was weak and not credible. 

A consortium of foundations decided to support a new national research center to raise 
the standard of research on charter schools and provide balanced perspectives on issues 
that had become polarized. The result was the National Charter School Research Project 
(NCSRP), which is the author of this report. 

The report is in two parts. In the first chapter, NCSRP provides new data based on sur- 
veys of state agencies and state charter associations. This first section explores questions 
such as: 

• Is the charter school movement growing or slowing down? 

• Do charter schools serve greater or fewer numbers of disadvantaged children than 
do regular public schools? 

• Are charter schools innovative? 

The first chapter also identifies several important questions on which state and local 
record-keeping needs to be improved. Given the data available, for example, it is hard 
to say anything definitive about per-pupil funding in charter schools, the size of wait- 
ing lists for admission to charter schools, or the instructional methods used. These are 
clearly significant issues that require further attention. 

The second part of this report takes up issues and controversies that have characterized 
the discussion of charter schools in the past year. NCSRP’s goal here is to examine these 
controversies in a broad context and assemble evidence in the most balanced and infor- 
mative way possible. While the six chapters outlined below are unlikely to settle any of 
these issues definitively, they may establish a more constructive basis for continued dis- 
cussion. 

STUDENT ACHIEVEMENT IN CHARTER SCHOOLS. Written by Paul T. Hill, direc- 
tor of the Center on Reinventing Public Education and former chair of a Brookings 
commission on school choice, this essay provides a fresh perspective on the controversy 
over the academic performance of charter schools. It examines existing research and 
concludes that the results are not as clear or believable as the contending sides in the 
“dustup” would claim. The essay points to data limitations and methodological chal- 
lenges that stand in the way of definitive research, and suggests how combinations of 
studies can answer questions that no one study can adequately address. 



BRINGING CHARTER SCHOOLS TO SCALE. Leaders and funders of the charter 
school movement are working hard to identify the most promising charter schools, 
model new charter schools after existing schools with the highest performance, and 
dramatically increase the numbers of high-performing charter schools — which they 
call “bringing charter schools to scale. ’’This essay by Robin J. Lake, executive director 
of NCSRP and associate director of the Center on Reinventing Public Education, 
identifies philosophical differences within the charter community itself about how to 
proceed and reviews the challenges of identifying and scaling up high-performance 
charter schools. 

THE IMPLICATIONS OF CHARTER SCHOOL CLOSURES. In September 2004 the 
multi-site California Charter Academy closed suddenly, forcing an estimated 10,000 
students to find new schools. This event fueled concerns about the risks faced by char- 
ter school parents and children, and the possible burdens on school districts that might 
have to find seats for hundreds of students on short notice. This essay, by Andrew 
Rotherham of Education Sector, extracts lessons from the California experience and 
suggests how charter authorizers and school districts can avoid catastrophic school fail- 
ures and sudden mass transfers of students. 

CHARTERS AS A “SCHOOL TURNAROUND” STRATEGY. One of the provisions 
of No Child Left Behind requires school districts to consider restructuring consistently 
low-performing schools as charter schools. Citing mixed conclusions on charter school 
achievement studies, critics worry that the “restructuring” provision threatens to toss 
students from the frying pan into the fire. This essay, written by education consultant 
Todd Ziebarth, and Priscilla Wohlstetter, a professor at the University of Southern 
California, considers how school districts and charter authorizers can make distinctions 
between charter schools that offer valuable options to students and those that do not. 

APPLES-TO-APPLES FUNDING COMPARISONS. Authorization to fund char- 
ter schools often fails to define how much money each should receive. Controversies 
have erupted in several states over whether charter school funding levels are appro- 
priate, given the costs of running a school and delivering good instruction. A recent 
report claims that charter schools are underfunded nationwide. This essay, written by 
Marguerite Roza, research professor at the Center on Reinventing Public Education, 
explores the details of how to compare charter school and traditional school funding. 
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The author contends that comparisons should take into account income and costs, for 
both charter schools and traditional schools. 

CHALLENGES TO A MATURING REFORM. Fifteen years ago, charter schools were lit- 
tle more than a gleam in the eye of school reformers, often justified by data demonstrat- 
ing low achievement in traditional public schools. Today, these schools are a reality in 
some 40 states, educating nearly one million students. However, the achievement shoe 
is now on the other foot. Charter schools are increasingly under pressure to demonstrate 
their performance using the same data used to justify their establishment. Authored by 
Paul T. Hill and James Harvey, this essay pulls together some of the strands of Hopes , 
Fears, & Reality . 

The National Charter School Research Project hopes these essays will help reframe 
discussions too often driven by political interests, both pro and con, but none of these 
essays is intended to be the final word. NCSRP is mounting ambitious research efforts 
on charter school student achievement, scale-up, and costs, and hopes these new studies 
will resolve many of the issues raised in these essays. 



1 National Center for Education Statistics, America's Charter Schools: Results From theNAEP 2003 
Pilot Study, NCES 2003-436 (Washington, D.C.: U.S. Department of Education, 2004). 




CHAPTER 



The Charter Schools 
Landscape in 2005 

Todd Ziebarth, Mary Beth Celio, Robin J. Lake , and Lydia Rainey 



M ost people know about charter schools from newspaper stories, 

mostly focused on disputes about approval or continuation of a par- 
ticular school or about the experiences of a limited number of stu- 
dents or teachers. Stories are valuable, but they do not always give a broad perspective. 
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Even when they rely on careful studies, press reports can contradict one another. For 
example, one study concludes “on average, charter students are not more disadvantaged 
than students in regular public schools .” 1 Another study states “charter schools are more 
likely to serve minority and low-income students than traditional public schools .” 2 



INTERESTED IN CHARTERS SHOULD KNOW BUT DO NOT 



Data on some characteristics of charter school students were hard to get from state charter school offices. While it was 
possible to conduct special analyses for race/ethnicity, free/reduced-price lunch, and special education, NCSRP was 
unable to do so for English language learners (ELL). In fact, because NCSRP was able to obtain data on ELL students 
for both charters and non-charters in only 12 states (with just 34% of all charter school students), the results are not 
included in this report. Given the importance of knowing which students are attending charter schools, it is critical that 
states collect and report student data on an annual basis. (Response rates by question are listed in Appendix B). 

It was also difficult to obtain data on how charter schools were performing within federal and state accountability 
systems. Only 16 states were able to provide information on the percentage of schools that made adequate yearly 
progress (AYP, as defined by No Child Left Behind ) for both charters and non-charters. It was even more difficult to 
track down the percentage of charters and non-charters that state accountability systems label as low-performing. With 
accountability playing such a prominent role within the charter school movement— as well as the larger movement to 
improve all public schools— states need to do a better job of making such information clearly and readily available. 

The survey also attempted to gather data about charter school per-pupil funding, waiting lists, parent satisfaction, and 
class size. Only a small number of states actually collect this information, too few to report at this time. The reality is 
that states do not provide information on many topics about which parents and the public express the greatest interest. 3 

NCSRP hopes to provide more such information in the future. But NCSRP will also make proposals about how states can 
standardize data collection and analysis for all public schools, whether district-run or charter. 
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These results depend on the data and methods used. 4 There are other important factual 
disputes, such as whether the charter movement is slowing down or continuing to grow. 

The National Charter School Research Project (NCSRP) set out to provide some basic 
facts about charter schools. NCSRP sought evidence from new sources by interviewing 
state officials in charge of charter schools and asking them to assemble data that had 
not been compiled before. Some important information has been uncovered, but many 
important facts are impossible to pin down. This chapter summarizes the survey results 
and also points out what the public and policymakers should be able to know, but pres- 
ently cannot. 5 

Based on the survey, NCSRP is able to draw eight major conclusions about charter 
schools in the 2004-2005 school year. This chapter explains and discusses each of them: 

1. Nationally, the number of charter schools grew faster in 2004-2005 than in any of 
the previous four years. 

2. Future growth is limited in many states by legislative caps on numbers and/or loca- 
tion of charters. 

3. Nationally, charter schools serve a larger proportion of minority and low-income 
students than is found in traditional public schools, a characteristic due largely to the 
disproportionate number of charter schools located in urban areas. 

4. Charter schools differ from traditional public schools in size and grade span. 

5. Alternate authorizers, such as state agencies or universities, are more likely to spon- 
sor brand new charter schools than to sponsor existing schools that convert to charter 
status. 

6. Few charters are operated by management organizations. 

7. Few states provide facilities funding, a fact that limits the number of charter schools 
that can be opened in a majority of states. 

8. Charter schools are creatures of state policy and therefore differ from one 
state to another and are as diverse as the states and the legislation that 
permit them. 




3 

FINDING # 1 : Nationally, the number of charter schools grew faster in 
2004—200 5 than in any of the previous four years. 

There has been speculation in recent years to the effect that charter school growth is 
stalling. However, the pace of charter school openings picked up speed in 2004-2005. 

The number of charter schools that opened in 2004-2005 (448) was much higher than 
the average of the previous four years (340) and nearly twice as high as in the 2003- 
2004 school year (260). As the 2005-2006 school year approached, approximately 3,300 
charter schools were operating in the 40 states and Washington, D. C. Based on the 
National Center on Education Statistics’ Common Core of Data, these 3,300 schools 
represent about 3% of all public schools in the country. Nationwide, charter schools 
serve more than 900,000 students, or 2% of all students attending public schools. 

Charter schools opened for the first time in Iowa and New Hampshire during the 
2004-2005 school year. In addition, states with relatively few charter schools — such as 
Indiana and Utah — experienced noteworthy growth, as did several states that already 
had substantial numbers of charter schools. 

THE CHARTER SCHOOL GROWTH RATE. The absolute number of new charter 
schools remains high, but the growth rate continues to decline because the base on 
which it is calculated is larger every year. Thus, the addition of 43 2 charter schools in 
1999-2000 constituted a 41% increase in the total number of schools, while the addition 
of 448 schools last year translates into a much more modest rate increase of 15%. Figure 
1 provides details of this growth from two charter schools in Minnesota in 1992-1993 
to 3,403 in 40 states and Washington, D. C., in 2004-2005. 

In number of schools, as in number of students, the data collected by NCSRP revealed 
that growth is concentrated in certain states, with 65% of all new charters opening 
in California, Colorado, Florida, Michigan, Minnesota, Ohio, and Wisconsin. Each 
of these states already had at least 100 charter schools, and together they have more 
than half of all charter schools nationwide. On the other hand, growth in many states 
was numerically small but proportionally large, with charter schools opening for the 
first time in Iowa and New Hampshire. Kansas and Tennessee added 14 and 3 schools 
respectively, but both had growth rates greater than 40% (52% and 43% respectively). In 
25 states the number of charter schools grew by 10% or more. 
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FIGURE 1: CHARTER SCHOOL GROWTH: NEW AND TOTAL CHARTER SCHOOLS, 1992-2005 
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Source: 2004-2005 data 
from NCSRP survey; 
all other data from Center 
on Education Reform, 
www. ed reform, com 



CHARTER SCHOOL STUDENTS. The range in the number of students enrolled per 
state is also very broad, from 140 in Wyoming to 180,000 in California. As Figure 2 



makes evident, charter school students, like the schools themselves, cluster in a limited 



number of states. Just six states account for 62% of charter schools and 63% of charter 
school students: Arizona, California, Florida, Michigan, Ohio, and Texas. These “Big 
Six” charter school states, however, are not necessarily the states in which charter schools 
play the greatest role in serving public school students. 



As Figure 3 indicates, the Washington, D. C.’s charter schools serve by far the most 
significant share of all public school students — 24%. 6 Charter schools in Delaware and 
Colorado also serve relatively high proportions of all public school students. Although 
charter students are numerous in California, Florida, and Texas, they still comprise very 
small proportions of those states’ total student populations. 




FIGURE 2: PERCENT OF NATIONWIDE CHARTER SCHOOLS/STUDENTS BY STATE IN 2004-2005 
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FIGURE 3: STUDENTS IN CHARTER SCHOOLS BY STATE IN 2004-05 



6 



ARIZONA 
DELAWARE 
COLORADO 
MICHIGAN 
OHIO 
ALASKA 
FLORIDA 
WISCONSIN 
HAWAII 
CALIFORNIA 
PENNSYLVANIA 
IDAHO 
NORTH CAROLINA 
MINNESOTA 
MASSACHUSETTS 
NEW MEXICO 
TEXAS 
UTAH 
RHODE ISLAND 
MISSOURI 
NEVADA 
NEW JERSEY 
GEORGIA 
ARKANSAS 
NEW YORK 
ILLINOIS 
LOUISIANA 
SOUTH CAROLINA 
OREGON 
CONNECTICUT 
INDIANA 
OKLAHOMA 
KANSAS 
WYOMING 
TENNESSEE 
NEW HAMPSHIRE 
MISSISSIPPI 
VIRGINIA 
IOWA 




Source: National 
Charter School 
Research Project , 2005 



PERCENTAGE OF PUBLIC SCHOOL STUDENTS IN CHARTER SCHOOLS 



CHARTER SCHOOL CLOSURES. By design, non-performing charter schools are sup- 
posed to close their doors. In addition, some will probably fail due to inability to attract 
students. In 2004-2005, about 65 charter schools — some with multiple campuses — 
closed their doors in 17 states and Washington, D.C. The number of closings ranged 
from a single school (in eight states and Washington, D.C.) to 21 schools (California). 
In 15 states, not a single charter closed last year. The 65 closed charters represented 2% 
of the charter schools in reporting states. Overall, the ratio of schools closed to schools 
opened is about one to seven. In Arizona and Alaska, however, the numbers of charter 
school openings and closings are very nearly equal. Figure 4 displays this information 
for all reporting states. 

CHARTER SCHOOL AGE. Many charter schools are brand new and some have been 
in existence for only a few years. Nationally, the average charter school has been open 
slightly less than five years. 7 However, since charter schools often grow one grade at 
a time, many are still offering instruction for some age groups for the first time. Most 
multi-grade schools still have not graduated a cohort of students — for instance, from 
elementary to high school or from high school to college. 



FINDING #2: Future growth in numbers is limited by state caps. 

Since the first charter laws were enacted, supporters and opponents have struggled over 
caps on the number of schools allowed to open. Most states incorporate such caps in 
their statutes, sometimes as a result of political compromises negotiated during the ini- 
tial decision to authorize charters within the state. 

As of 2004-2005, 27 states’laws limit the number of charter schools. Twenty states 
set caps on the total number of new schools that may open. These caps are imposed 
statewide, on particular cities, or on particular authorizing agencies. The other seven 
states limit charter school growth based on other criteria, including the number of 
students who may attend charter schools (Connecticut) or total district expenditures 
(Massachusetts). 
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FIGURE 4: OPENED AND CLOSED CHARTER SCHOOLS BY STATE IN 2004-2005 
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Figure 5 (next page) displays the number of charters that are available, by state, under 
current absolute state caps. Under current state caps, there is room for just 725 more 
schools nationwide. Almost half of this unused capacity (340 charters) is available in 
California. Three of the states with the most charter schools (Michigan, Ohio, and 
Texas) can create a combined total of just 29 more schools under the current caps. 

Most states are clearly bumping up against their caps, making it likely that, barring 
legislative changes, charter school growth in these states will grind to a halt in the next 
few years. 

FINDING # 3 : Nationally, charter schools serve a larger proportion 
of minority and low-income students than traditional public schools, 
due largely to the disproportionate number of charter schools located in 
urban areas. 

There is a great deal of heat to the debate about whether charter schools serve the 
disadvantaged or “cream” student populations to serve the easy to educate. In order to 
gain precise and up-to-date information on the demographic makeup of charter school 
students, NCSRP asked state charter school sources to provide data on race/ethnicity, 
free/reduced-price lunch, and special education for charter school students. This infor- 
mation was combined with information from the Common Core of Data (NCES) on 
the public school districts in which each of the charter schools in the 30 reporting states 
are located. 8 

LOCATION OF CHARTER SCHOOLS AFFECTS ENROLLMENT. One of the char- 
acteristics of charter schools most likely to affect the types of students served is loca- 
tion. In fact, the NCSRP survey revealed that charter schools are three times as likely 
to be located in big city districts as are public schools in general, and half as likely to 
be located in small town or rural districts: in 2004-2005, 10.4% of all public schools 
in the United States were in big city districts, while 30.5% of all charter schools were 
located in big city districts. At the other end of the spectrum, while over 45% of all 
public schools were located in small towns or rural districts, 24% of charter schools were 
located in such districts. 
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FIGURES: NEW AND TOTAL CHARTER SCHOOLS BY STATE, 2003-2005 
PLUS N UMBER AVAILABLE UNDER CAP (If Any) 
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MINORITY ENROLLMENT IN CHARTER SCHOOLS. Not all states were able to provide 
information on charter school minority enrollment, but the 30 states that provided racial 
and ethnic data are host to 94% of all charter schools and 97% of all charter school stu- 
dents. Data from the remaining states would not change the overall picture presented here. 

Nationally, charter schools enroll a significantly higher proportion of minority students 
than do the states in which they are located: over half (5 8%) of the students enrolled in 
charter schools belong to a racial/ethnic minority group, while 45% of students within 
the public school districts in the same states are members of minority groups. However, 
there is almost no difference in the minority makeup of charter schools and the districts 
in which they are geographically located (59% minority in charter schools versus 60% in 
“host” districts). 




The national figures mask major differences state to state, as indicated in Figure 6. 

Charters in 15 states and Washington, D.C., serve a larger percentage of minority stu- 
dents than do regular public schools in their host districts, while charters in 13 states 
serve a lower percentage of such students. 

FIGURE 6: DIFFERENCE BETWEEN MINORITY ENROLLMENT IN CHARTER SCHOOLS AND IN 
DISTRICTS THAT HOST CHARTER SCHOOLS, BY STATE, 2005 

Positive numbers indicate the % minorities and FRL in charter schools is larger than the % minorities and FRL in host district 




Source: National 
Charter School 
Research Project, 2005 
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LOW-INCOME ENROLLMENT IN CHARTER SCHOOLS. Charter schools enroll a 
higher percentage of low-income students than do the states in which they are located, 
and they serve about the same percentage of low-income students as do the districts 
they are located within. 9 Overall, 5 2% of students enrolled in charter schools are eligible 
for free/reduced-price lunch (FRL), compared to 40% of all public school students in 
the same states and 5 1% in the same districts. Data on free/reduced- price lunch eligi- 
bility were available for only 2 1 of the 40 charter school states, making these findings 
somewhat less solid than the minority enrollment data, but the fact that the states that 
provided this data enroll 63% of all charter school students suggests that the relation- 
ship may also be seen in non-reporting states. Figure 7 provides details. 



As with minority enrollment, the difference in low-income enrollment between charter 
schools and their host districts varies dramatically from state to state. Figure 8 displays, 
as words alone cannot, the immense differences in demographic makeup of districts and 
charter schools among and within states. 



FIGURE 7: PERCENT OF STUDENTS ELIGIBLE FOR FRL IN ALL DISTRICTS, 
IN DISTRICTS THAT HOST CHARTERS, AND IN CHARTER SCHOOLS, 2005 
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Source: National 
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Research Project, 2005 
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FIGURE 8 : DIFFERENCE BETWEEN MINORITY 81 FRL ENROLLMENT IN CHARTER SCHOOLS 
AND IN DISTRICTS THAT HOST CHARTER SCHOOLS, BY STATE, 2005 

Positive numbers indicate the % minorities or FRL students in charter schools is larger than the % minorities or FRL students in host district 
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In short, charter schools are geographically located in those districts that serve a dispro- 
portionate number of students who have traditionally been found to be most at risk of 
educational failure: those in large urban areas, those who live in poverty, and (in many 
states) those who are members or racial or ethnic minorities. Moreover, their student 
populations also appear to be generally representative of nearby district-run schools. 
However, the mixture of the risk elements differs by state, making it difficult to make 
hard-and-fast generalizations about charter schools. Better studies of charter school 
enrollment, including finer measures of students’ prior educational experience and fam- 
ily background, are needed. 

SPECIAL EDUCATION ENROLLMENT IN CHARTER SCHOOLS. Nationwide, char- 
ter schools serve a lower proportion of special education students than do other public 
schools. About 10.8% of charter students are classified as special education students, 
compared to 13.4% of students enrolled in traditional public schools. 10 This gap is essen- 
tially the same as it was in 1998-1999. 11 Two states (New Mexico and Ohio) buck the 
national trend, with charters serving a higher proportion of special education students 
than other public schools. 



FINDING # 4 : Charter schools differ from traditional public schools in size 
and grade span. 

Supporters claim that charter schools offer more intimate learning environments and 
give parents options not otherwise available. Our data show that charter schools deliver 
on these promises. They are much smaller, on average, and offer grade configurations 
that are not widely available in other public schools. 

In 2004-2005, the average size of a charter school was 256 students — about half the 
average size of non-charter public schools. Charter schools were smaller than district- 
run public schools in every state but two. 
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Elementary schools are typically smaller than secondary schools. If charter schools were 
more likely to serve traditional elementary school grades than other public schools, that 
might explain the smaller school size, but that is not the case (see Figure 9). Slightly 
more than one quarter of charters are elementary schools, compared to nearly half of all 
public schools. Overall, 55% of charter schools served some combination of elementary 
and middle school grades only in 2004-2005, much lower than the 73% of all public 
schools that do so. A higher proportion of charter schools (25%) serve some combina- 
tion of high school grades than do other public schools (19%). 

Charter schools also offer unconventional grade spans. 12 Figure 9 shows that charter 
schools are much more likely to organize themselves as K-8 and K-12 schools than 
are traditional public schools. As shown below, 43% of charter schools served non- 
traditional combinations of grade levels, such as K-8 or K-12 schools, as compared to 
only 16% of all district-run public schools. 




Charter schools’ offering unusual grade configurations — especially ones that elimi- 
nate separate middle schools and reduce the numbers of times a child must transition 
between one school and another — creates options for parents. 



FIGURE 9: GRADES SERVED BY CHARTER SCHOOLS AND OTHER PUBLIC SCHOOLS, 2005 
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FINDING # 5 : School boards sponsor different mixes of charter schools than 
do other authorizes. 

Does it matter whether only school boards can authorize schools? There is an ongoing 
debate about whether other public entities should be allowed to charter schools, and 
whether they would sponsor different kinds of schools than do school districts. Figure 
io outlines an intriguing connection between the authorizer’s identify and the type of 
school sponsored. In states that permit only local school districts to sponsor charter 
schools, nearly a quarter of all charter schools are converted from existing schools, most 
of which keep their teaching staffs intact (22%). The remainder (78%) is made up of 
new schools. 13 When states allow alternate sponsors, on the other hand, including uni- 
versities, state agencies, and other non-profits, only 6% of charters are conversions and 
94% of charter schools are started from scratch. 



FIGURE 10: LOCAL SCHOOL BOARD APPROVAL AND CHARTER SCHOOL TYPE, 2005 

■ CONVERSION CHARTER SCHOOLS ■ NEW CHARTER SCHOOLS 
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FINDING #6: Few charters are operated by management organizations. 

Some charter school opponents warned that small, innovative schools would be driven 
out by large organizations capable of operating many schools. Some proponents hoped 
that educational management organizations (EMOs) — both for-profit and non-profit — 
would play a significant role in increasing the number of charter schools. Experience to 
date does not bear out the fears or the hopes about EMOs. Our survey indicates that 
just 10% of all charter schools are operated by EMOs (either for-profit or non-profit) 
in Washington, D. C., and the 26 states and that reported such data. In other words, the 
overwhelming majority of existing charters are operated as single enterprises by local 
groups, teacher cooperatives, and community-based organizations. 

Here again, national numbers mask important state variations. Michigan and states such 
as Alaska and Minnesota are outliers. Fully 75% of the charters in Michigan are oper- 
ated by EMOs, by far the highest percentage of any state. In Alaska and Minnesota, by 
contrast, no charters are operated by EMOs. In other states, the percentage of charters 
operated by management organizations varies from 33% in Ohio and 26% in New York 
to 4% in Arizona and 2% in Wisconsin. 



FINDING #7: Few states provide facilities funding, a fact that limits the 
number of charter schools that can be opened in a majority of states. 

Charter school access to facilities funding is frequently a bone of contention. (Chapter 6 
provides greater detail on school finance issues related to charters, including accounting 
for facilities funding.) District-run public schools do not pay for facilities, but charter 
schools must buy, lease, or pay rent. Charter supporters often lobby states to provide 
facilities or subsidize the costs. 

NCSRP’s data indicate that few states currently provide such support. During the 
2004-2005 school year, just 13 states and Washington, D.C., provided funds for charter 
school facilities. Ten of these states and Washington, D.C., provided such funds in the 
form of per-pupil payments to charter schools. 
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While most states ignore facilities needs or provide amounts much lower than the actual 
cost, some jurisdictions are more forthcoming with funds. In Washington, D.C., for 
example, the amount provided on a per-pupil basis is derived from a five-year moving 
average of capital funds available to the school system. Charter schools may use these 
funds to meet various facilities needs. Minnesota provides lease aid to charter schools in 
the amount of 90% of lease costs, up to $1,200 per-pupil. 

Instead of providing facilities funds in the form of per-pupil payments, four states pro- 
vide grants and loans for facilities. California, for example, operates a revolving loan 
fund that allows charter schools to receive loans of up to $250,000 for facilities, with up 
to five years for repayment. Charter schools authorized by the state board of education 
in Connecticut are eligible for a one-time grant of $500,000 to assist in the financing of 
school building projects, general building improvements in school buildings, and repay- 
ment of debt incurred for prior school building projects. 



FINDING # 8 : Above all, charter schools are creatures of state policy and 
therefore differ from one state to another and are as diverse as the states 
and the legislation that permit them. 

From the data presented here the charter school movement, sometimes thought of 
as a national crusade, looks a lot more like a combination of loosely connected state 
initiatives. During the past year, the public and policymakers have watched as various 
researchers have tried to make sense of national achievement data. It is small wonder 
they have had such a hard time. Charter schools are often more different than similar 
from state to state. 

Why so much variation among states? Each state’s charter school law is unique, repre- 
senting that state’s preferences on everything from the purpose of the law to how charter 
schools are to be held accountable and for what. In addition, a state’s unique mix of his- 
tory — with education reform, the interplay of state and local politics, and traditions of 
school governance — plays a role in determining who ends up starting schools and what 
the schools look like. In some respects, chartering is more of an opportunity for changing 
existing schools than an opportunity to create new schools that fit a certain mold. 
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CHAPTER 



Assessing Achievement 
in Charter Schools 

Paul T. Hill 

T he average man or woman on the street trying to follow the dueling stud- 
ies on charter school performance probably greatly overestimates the vol- 
ume and quality of research available. There really is not a lot of reliable 
research on the topic. Although there are press reports about charter schools with very 
high or low student test scores, almost all of these reports suffer from serious shortcom- 
ings of data or methods. As part of the commitment of the National Charter School 
Research Project (NCSRP) to provide a balanced perspective on charter school research, 
it committed to analyzing every study on the link between charter school attendance 
and student academic achievement. 

News coverage of this year’s dueling publications reveals a mismatch between what the 
available research can tell us and what policymakers and concerned citizens want to 
know. Everyone wants to know whether children attending charter schools benefit or 
suffer harm. The answer to this question cannot be observed directly, since benefit or 
harm depends on what other opportunities the students had. Comparisons are necessary. 
Researchers inevitably reformulate the question in this way: “Do students in charter 
schools learn more than they would have learned in a conventional public school?” Even 
this question is hard to answer, since no student can be in two kinds of schools at once. 
To get at the question, researchers must make a number of imperfect comparisons and 
employ complicated statistical tools. The results often depend on the methods used, and 
the same numbers might support positive or negative conclusions, depending on how 
they are analyzed. 1 
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In August 2004, a study by the American Federation of Teachers (AFT) grabbed the 
headlines. The AFT report analyzed data from the National Assessment of Educational 
Progress (NAEP) and concluded that charter school students had lower achievement, 
both in fourth grade and eighth grade, than other public school students. They also 
looked at the achievement gap between students who were and were not eligible for 
free/reduced-price lunch, and found it was slightly larger in charter schools than in 
regular public schools on two tests, fourth grade reading and eighth grade math. These 
results were troubling, though the methods used did not fully account for differences in 
the student populations served by the two kinds of schools. 

Ultimately, the U.S. Department of Education’s Institute for Education Sciences 
issued its own analysis of the data used in the AFT report. 2 Based on fourth-grade 
reading and math performance of some 3,300 students, it reproduced many of the 
AFT’s findings. 

A third prominent study analyzed charter school student performance on state assess- 
ments. 3 Produced under the imposing banner of Harvard University, this study made 
much of the fact that it covered 99% of enrollments in charter schools, far more than 
the NAEP’s 3% sample. It compared charter schools with the schools their students 
would most likely otherwise attend, and argued that charter school students were more 
likely than students in matched schools to be proficient in reading and math on state 
exams. Coverage of the Harvard study suggested it was developed as a sort of antidote 
to the AFT and U.S. Department of Education findings. 

In the spring of 2005, two groups with opposing perspectives on charter schools pub- 
lished reviews of existing research. The review by the AFT-allied Economic Policy 
Institute concluded that the available findings on charter school effectiveness were 
neutral to negative. 4 The Charter School Leadership Council drew the opposite conclu- 
sion. 5 Though the two groups reviewed many of the same studies, they each excluded 
some studies from consideration for various reasons. 

Dueling studies are not unique to charter schools. As a recent report in the Journal of 
the American Medical Association shows, many publicized reports on the effectiveness of 
drugs and other therapies are premature. Some research findings are later demonstrated 
to be inaccurate. 6 In medical research — a much more mature and infinitely better- 



funded enterprise than educational research — big questions are settled only after many 
sophisticated studies using different methods reach the same conclusion. 

STUDIES OF LOCALITIES AND INDIVIDUAL SCHOOLS 

NCSRP began its review of smaller-scale studies by examining every report published 
since 2000. The review uncovered 41 studies that report on links between charter school 
attendance and student test scores. 7 None of them report on longer-term results like 
persistence in school success at the next level of education, graduation rates, or college 
attendance. 

Of the 41 studies, 26 focus on charters in a single state. There are multiple studies of 
some states — five on California, four on Texas, and three on Florida — and no studies at 
all on 28 states. Because data on charter school performance is not always readily avail- 
able, researchers have used what they could obtain. Frequently the data sets are almost 
primitive. Of the 26 studies, 12 make aggregate comparisons of charter and public 
school performance without specifying which grade levels are analyzed. None start with 
data that can be taken as representative of all the charter schools or students in the state. 
About a dozen studies seem to examine multiple grade levels, but do not say how many 
students there were in each grade. 

Of the universe of 41 studies, NCSRP was unable to locate one, and five are meta- 
analyses that try to discern trends by combining studies done in single states. The meta- 
analyses only review the individual studies, so NCSRP has also excluded them from 
Table 1 (below), which covers 35 studies. 



TABLE 1: RESULTS OF 35 CHARTER ACHIEVEMENT STUDIES DONE SINCE 2000 



DIRECTION OF 
RESULTS 


TYPE OF ANALYSIS 


Mean-to-mean 
comparisons, no 
controls 


Multivariable analysis 


Regression analysis, 
randomization, multi- 
year student scores 


Total 


Positive 


4 


3 


8 


15 


Neutral or mixed 


4 


0 


6 


10 


Negative 


5 


2 


3 


10 
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Due to the low quality of many studies, it is hard to know what to make of the results or 
how to weight them against each other. Do several flawed studies pointing in the same 
direction tell us something worth knowing, despite the flaws? Or does one well-done 
study outweigh ten weak ones drawing different conclusions? 

Table i summarizes the analysis. It compares the count of pro- and con-charter stud- 
ies and distinguishes them by the methods employed in the studies. Table i , to repeat, 
excludes the five meta-analyses that re-analyzed data published by others. 

The results displayed in Table i are mixed. Out of the 35 studies, 15 produce gener- 
ally positive findings, with the lion’s share accounted for by studies employing relatively 
sophisticated approaches — multivariate analysis, regressions, randomization, and the 
like. But even studies employing these methods are about evenly divided between those 
finding positive results and those that are neutral, mixed, or negative. Of the studies, 20 
(57% of the total) provide neutral, mixed or negative results — with nearly half of them 
(nine studies) relying on average comparisons, without controls. It seems that, regardless 
of the methods used, the results are variable. There are some positive and some negative 
results, whatever the methods employed. 

It should also be noted that whether studies draw positive or negative conclusions 
about charter school effectiveness, the differences are not strong. This is so for two rea- 
sons. First, outcomes for many charter schools are virtually identical to the comparison 
groups. Second, although some charter schools have outstanding results, schools getting 
poor results statistically offset them. As with traditional public school results, averages 
conceal almost as much as they reveal. 

Some of the newer studies are beginning to use superior methods. They are also much 
more careful about saying whether their results can be applied more broadly to charter 
schools or only to a limited set of schools. However, the most sophisticated studies focus 
on the three states where especially good data on student achievement are becoming 
available — Texas, Florida, and North Carolina. Only these studies can compare learn- 
ing rates of individual students before and after they enter charter schools, but even the 
data from these states cannot be used to generalize about all charter school students. 8 Of 
the studies in these states, two report mixed results, and one reports negative findings. 
Differences, whether positive or negative, are also quite small. Moreover, results cannot be 
readily applied to the other 38 states. Every state has its own peculiar mix of regulations, 
barriers to entry, and funding provisions, all of which affect results. 



Several new federally funded studies are in the field. Some attempt to examine a nation- 
ally representative set of charter schools. Others compare charter school students with 
students who applied to charter schools but were turned away for lack of classroom space. 
These “randomized” studies are a major step forward, but they too can provide only partial 
answers, since they represent only charter schools popular enough to have waiting lists. 



WHAT’S SO HARD ABOUT THIS? 

Everyone wants to know whether students in charter schools are learning more or less 
than they would have learned in conventional public schools. This is a reasonable ques- 
tion, but it is easier to ask than to answer for two reasons. 

First, it is impossible to observe the same students simultaneously in both charter schools 
and the schools they would have attended if charter schools had not been available. Thus, 
it is necessary to create a “counterfactual” by comparing students in charter schools with 
other students who are similar in some ways but do not attend charter schools. 

Second, there are many kinds of charter schools — some serving the poor and disadvan- 
taged and others serving the advantaged; some receiving the same amount of money as 
nearby public schools and others much less; and some in supportive local environments 
and others constantly fighting off attacks from their local school districts and teachers 
unions. The results of studies focusing on one kind of charter school cannot be general- 
ized to all charter schools. 

Depending on the data they have available, researchers typically make one of five com- 
parisons to estimate the difference between charter school students’ measured achieve- 
ment and the achievement levels they would have attained had they not attended a 
charter school. Charter school students are compared with: 

• students in the public schools that charter school students had previously attended 
(similar to the approach used by Caroline Hoxby at Harvard University); 

• students in public schools that are like, but not necessarily identical to, the public 
schools that the charter students would otherwise have attended (similar to the 
AFT and NAEP comparisons); 

• students similar in age, race, and income level to charter school students, but 
not necessarily from the same or similar schools that the charter school students 
would have attended; 
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students who applied to the charter schools but were not admitted because all the 
seats had been taken; or 

students’ own rates of annual growth before and after entering charter schools. 
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Each of these comparisons has its advantages and disadvantages. For example, while it 
seems to be an advantage to compare charter school students with local (‘matched’) stu- 
dents in neighboring schools, students who leave particular public schools may not be at 
all like the students who remain behind. Students change schools for a reason — whether 
because their prior school was too easy for them, or because they were doing badly in 
it. A comparison with former classmates can be misleading. It makes sense to compare 
public school and charter school students from similar racial and income backgrounds, 
but there is no assurance that one group’s attendance at charter schools is the only dif- 
ference between them. There is nothing wrong with making such comparisons — some- 
times they are the only ones feasible — but they have their limits. 

The same is true of comparisons between charter school students and children who 
applied to the same schools but lost out in a lottery or were placed on a waiting list. This 
approach factors out any self-selection bias by holding it constant. Parents of all the 
children in the study will have sought admission to the same charter schools, so there 
should not be differences in motivation or other hard-to-measure attributes between 
students attending the charter schools and those who did not get in. But even these 
comparisons have their shortcomings. Children not admitted to a particular charter 
school often enroll in another — or in public school classrooms different from those they 
would have attended had their parents not sought admission to a charter school. 

Comparing students’ current rates of learning growth with their own past growth rates 
eliminates the inevitable differences between students who do and do not attend charter 
schools. However, this method is seldom feasible because of the absence of complete 
student records containing comparable test results for different grade levels. Even in 
states that are building identical test score files for all students, complete records are 
available for only a fraction of the students. Because this method requires that students 
establish score trajectories in public schools before entering charter schools, it ignores, 
by design even if not deliberately, children who enter charter schools in the earliest 
grades. Students entering charters at later grades may also pose very different educa- 
tional challenges than children entering in kindergarten, first, or second grade. Thus, 
the studies that focus on students for whom many years of test scores are available are 
hardly likely to be representative of charter school students overall. 
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METHODOLOGY MATTERS: CHARTER SCHOOLS AND ADEQUATE YEARLY PROGRESS 

Scott F. Abernathy 



In a recent Washington Post story on the Washington, D.C., charter schools, only eight of the district’s thirty-one charter 
schools achieved adequate yearly progress (AYP, as defined by No Child Left Behind) in 2005. 9 Many charter schools in 
other localities also failed to meet AYP. 

Does this mean that a majority of charter schools in Washington, D.C., and elsewhere are failing to educate their 
students? The answer is that NCSRP cannot know from the AYP data, for two reasons: First, thirteen Washington, D.C., 
charter schools failed to make AYP only because they served such diverse student populations that no subgroup was 
large enough to support calculation of AYP. 10 It is therefore impossible to judge them. Second, the ten charter schools 
that failed to make AYP were serving highly disadvantaged students who can seldom meet AYP, given the way it is 
calculated. 

AYP calculations are based on a “status model” of educational achievement, which relies on a one-time snapshot of 
student proficiency. 11 Students who start at a very low level of achievement can fail to make AYP even if they are learning 
rapidly in school. The implications of the “status model” can be illustrated using test data from Minnesota, where, as in 
Washington, D.C., charter schools were more than twice as likely as regular public schools to fail to make AYP. 

Figure 1 analyzes schools in Minnesota that failed to make AYP in 2004. It contrasts charter schools with public schools 
at different grade levels that serve the same high proportions of minority and low-income students. 

As the figure shows, the 47% AYP failure rate of Minnesota’s charter schools was lower than the 61% failure rates of 
regular public schools serving similar proportions of disadvantaged students. This does not prove that charter schools 
are doing better than regular public schools: some might have very small subgroups, and there might be unmeasured 
differences in student populations that make the challenges facing regular public schools even harder than those faced 
by charter schools. But the data do show that, even in states where many charters fail to meet AYP, it is inappropriate to 
say they are doing worse than comparable district-run schools . 12 



FIGURE 1: PERCENTAGE OF MINNESOTA'S SCHOOLS NOT MAKING AYP IN 2004 
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In general, studies that rely on small numbers of students — the few who lost out in an 
admissions lottery or the few for whom multiple years of test scores are available — are 
not terribly reliable. Critics of the “Adequate Yearly Progress” (AYP) requirement in No 
Child Left Behind have made a similar point: test results for small samples of students 
are highly unstable. What appear to be differences in school performance can be due to 
measurement error . 13 These errors are less important in large samples, but results based 
on small samples can be severely distorted. Scott Abernathy’s sidebar shows additional 
ways that charter schools’ AYP results can be misinterpreted. 

The point here is not that such studies should be avoided, but that each method has its 
flaws. In an ideal world, all of these comparisons would be made, and if the results were 
similar on all of them, one could have greater confidence in the findings. In the real 
world, however, particular studies can make only one or two of the comparisons, and the 
results often differ. One is forced to find out why the results differ — tedious work, but 
the only way to answer a hard question. 

Even if good comparisons could be made, so that one could say with confidence 
whether or not students in a particular school learned more than reasonably compa- 
rable students did elsewhere, it is often wrong to generalize those findings to all charter 
schools. Charter schools serve very different student populations and operate under very 
different circumstances. Positive student-achievement results for charter schools serv- 
ing low-income students don’t necessarily apply to schools serving less disadvantaged 
groups, and vice versa. 

In the same manner, results for schools that are well financed and strongly supported 
by their authorizers — for example, charter schools in Chicago or Massachusetts — don’t 
necessarily apply to schools that receive less funding or must cope with a hostile local 
environment. And it is highly unlikely that findings about traditional public schools that 
have been converted to charter status can be reliably generalized to newly formed char- 
ter schools. 

In the short run, research on charter school performance is also limited by the outcome 
measures available. Test scores are one sort of outcome, of course, but there are others. It 
matters whether students attend school and persist until they complete a course of study, 
so it makes sense to ask what proportion of students persist to graduation. Other perfor- 
mance measures could include: the rate at which students pass key “gatekeeper” courses; 
whether or not they are able to pass core courses at the next level of education (if gradu- 
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ates of an elementary school, for example, take and pass algebra by the end of the ninth 
grade); and rates of completion of the next higher level of education. 

Many of the scholars who have studied charter schools are skilled and imaginative, 
so why is the body of research available so weak? One answer is that charter schools 
are relatively new and evidence on their performance is just emerging. Another is that 
significant funding for charter school research is just becoming available. To this point 
researchers have had to take advantage of whatever data they could get and learn what 
they could even if the results were imperfect. 

Here is the most important answer: until very recently education research has not focused 
on how to judge the performance of individual schools, charter or not. Most evaluations 
have focused on instructional programs in single subjects (e.g., reading) or on programs 
that cut across schools (e.g., Title I or class size reduction). Questions about whole school 
effectiveness were not generally taken up, perhaps because schools were assumed to be 
permanent or because researchers understood the complexities involved. 

Research on the effectiveness of whole schools focused on marginal cases — for example, 
parochial schools, magnets, or voucher-redeeming private schools. These studies by 
James Coleman and others pioneered many of the methods now being used to assess 
charter school performance. 14 But they were not generally used to assess regular public 
schools. School effectiveness research became a core issue for public education only 
when states and localities considered accountability schemes that could lead to school 
closure and replacement. But assessment proved technically and politically difficult, and 
few of the 48 states committed to standards-based reform ever figured out how to judge 
whether a school was good enough to continue or bad enough to need replacement. 

Now there is a sense of urgency about how to judge individual schools, due both to the 
rise of charter schools and the implementation of No Child Left Behind. Unfortunately, 
the perceived need has leapt beyond the evidence available. 

NCSRP will soon publish a white paper on the most promising methods for obtain- 
ing national estimates of charter school performance. NCSRP hopes studies using these 
methods will start providing stronger evidence. However, the truth is that Americans 
are just now starting to ask tough questions about the effectiveness of particular schools, 
and to keep and analyze the kinds of hard data needed. The opportunistic and relatively 
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crude studies done to date are actually reasonably good for the early stages of a scientific 
inquiry, but they are not sound bases for policy. 

THE RUSH TO JUDGMENT 

There are two other possible explanations for the rush to draw conclusions about the 
effectiveness of charter schools. The first is the desire to distinguish the characteristics 
of more versus less effective charter schools, so that foundations and public agencies 
can favor charter applicants more likely to succeed. The second is the desire to limit the 
growth of the charter movement in order to protect (existing) non-chartered public 
schools and their employees from losses of money and jobs when students move from a 
district-run school to a charter school. 

Both explanations fit some of the facts. Government agencies responsible for authoriz- 
ing charter schools (e.g., the Chicago Charter Schools Office) have also drawn practical 
conclusions about what kinds of school providers are most likely to succeed, and foun- 
dations that sponsor charter schools have watched schools closely. Foundations often 
rely more on direct clinical observation than on scientific standards of evidence, and it 
is clear that they have changed their investment strategies, believing that schools started 
by independent groups with little education experience were less likely to be effective 
than schools founded by experienced groups with definite ideas about instruction. (See 
Chapter 3 for a discussion of bringing charter schools to “scale.”) 

On the second explanation, it is clear that some charter school studies are done by 
groups that simply want to promote the movement or slow it down. This motivation 
is even stronger now that No Child Left Behind identifies charter schools as possible 
remedies for children in consistently low-performing public schools. This could lead to 
significant increases in the amounts of formerly district-controlled funds transferred to 
charter schools. Positive findings might encourage legislatures to allow greater numbers 
of charter schools and to reduce regulation. Negative findings might lead to reductions 
in numbers of charter schools, greater regulation, and cuts in the amounts of money that 
follow children when they transfer from district-run schools to charters. 




WHAT CAN NCSRP KNOW IN THE FUTURE? 



Research on charter school effectiveness is getting better, and researchers’ claims about 
the significance of their own results are becoming more disciplined. Future editions of 
this report should be able to report more meaningful results. 

Though currently available research supports few firm conclusions, there are tantalizing 
hypotheses worth investigating and either proving or rejecting. For example: 

• The policy environment in which charters operate limits the degree to which 
charter schools can differentiate their programs and results from surrounding 
public schools. State laws, funding policies, and rules about teacher qualifications 
and independence of collective bargaining agreements might all affect charter 
school success. 

• Charter schools creating the most value for their students serve a student popula- 
tion whose public school alternatives are of very low quality. 

• Charter schools struggle when they attract children whose previous school perfor- 
mance was much worse than average for children from the same neighborhood, 
income group, race, or ethnicity. 

• The performance of new charter schools improves steadily over their first five 
years of operation. 

• Affiliation with an experienced school provider can speed up the school matura- 
tion process. 

In future years, our reports will provide more definitive evidence about these and other 
factors in charter school success and failure. If recent patterns continue, the charter 
movement itself will be far ahead of policymakers in using research results to empha- 
size the most promising kinds of schools and fix emerging problems. Thus, the research 
will probably always lag a bit behind charter school practices and their performance. 
Policymakers eager to judge the worth of charter schooling as a public policy will prob- 
ably always find the hard evidence helpful but not definitive. 
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CHAPTER 

Bringing Charters to Scale 

Robin J. Lake 

ost disputes about charter schools revolve around disagreements 
between charter supporters and opponents. Yet one controversy is 
lodged firmly in the charter school movement: How should charter 
schooling be taken “to scale”? That is to say, how should the number of charter schools 
be increased to reach dramatically more students with the highest quality of charter 
schools possible? 

At some risk of oversimplification, it can be said that on one side of the debate there 
exists a national push toward replication of successful schools, investment in school 
management organizations, and expansion of state laws to allow for many more charter 
schools. On the other side are those who favor approaches that respect and foster the 
sometimes-messy grassroots or homegrown origins of the charter school movement. 
Despite this oversimplification of a complex set of people and ideas, events this past 
year demonstrated the charter school community quickly dividing along these lines. The 
outcome of this debate may determine the fundamental character of charter schools for 
years to come. 

HOW MANY CHARTER SCHOOLS ARE ENOUGH? 

When people refer to “scaling up” the charter school movement, they often mean differ- 
ent things. One way to think about the issue is that charter schools will be adequately “at 
scale” when there are enough high-quality charter schools to satisfy parental and govern- 
ment demand. Another view is that charter schools will not be “at scale” (regardless of 
parental demand) until they are able to deliver on their most important promise, which 
is that there will be enough of them competing with school districts to force traditional 
public schools to improve. 





CHAPTER 3: BRINGING CHARTERS TO SCALE 
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Whichever view advocates hold, most agree that the charter school movement, in 
2005 , is still, for most states and school districts, a small fish in a big pond of school 
reform strategies. 1 There are notable exceptions in some cities and school districts, 
such as Washington, D.C. These exceptions are the result of isolated state charter laws 
designed to encourage a lot of charter schools to open quickly to facilitate competition 
and choice. In other cases, concentrations of charter schools reflect strategic choices by 
school district superintendents or board members that are trying to use charter schools 
as a way to replace failing district schools or to increase options for parents. But in the 
end, the numbers show small percentages of students served and caps that limit the 
number of future charter schools. 

Clearly, supporters of the movement hope it will mature into a more mainstream reform 
that improves academic life for a greater numbers of students. To that end, charter 
school funders, founders, policymakers, and critics of public schools and public services 
are increasingly calling for strategies to take successful schools “to scale,” while working 
toward that aim through legislative lobbying and political activism. During the past two 
years, no charter school conference was complete without a session on “getting to scale,” 
while big investors such as the Bill and Melinda Gates and Walton Family Foundations 
made significant grants to help speed charter school growth through technical assis- 
tance, replicable school designs, and other means. 

There is a missionary tone to the message of charter school advocates, a belief that an 
expanded charter movement is urgently needed to overcome the odds on high drop- 
out rates, low levels of family satisfaction, and disappointing overall achievement. There 
are different theories on how to dramatically increase the number of American charter 
schools, but few charter supporters would be happy to see charter school growth stop 
where it is today. 

At the same time, charter school opposition is alive and well, with teachers unions and 
other groups continuously working to slow charter school growth through legislative 
lobbying and political activism. 




WHY CONSIDER NEW APPROACHES TO CHARTER SCHOOL GROWTH? 



Advocates are eager to find new ways to speed charter school growth because creating new 
schools one-by-one has proven time-consuming and too often results in uneven quality. 
Schools started by groups of talented and innovative local teachers or community-based 
organizations are still necessary, in this view, but so is an effort to take working models and 
use their core ideas in additional places. 

Increasing the numbers and average quality of charter schools is very important to 
localities such as New Orleans, Chicago, and New York City, which have concluded that 
their schools are not going to turn around quickly enough to avoid harm to children 
and sanctions under No Child Left Behind. (See Chapter 5 for a discussion of charters as 
a school “turnaround strategy.”) Some communities are convinced they need to create 
many new schools, but they do not have access to local expertise or organizations capa- 
ble of providing them quickly or reliably. In these communities, importing a successful, 
functioning model from elsewhere is a very attractive option. 

Building many schools on one core plan is not a new idea. Montessori schools fol- 
low a template of sorts. So do parochial schools, and it is normally a template different 
in both subtle and significant ways from Jesuit schools, a particular type of Catholic 
school. With the exception of parochial schools, which blossomed practically overnight 
in Eastern cities after an 1870 Baltimore convention of Catholic leaders, the spread of 
most of these new schools has been pretty gradual. It was accomplished largely by expe- 
rienced leaders moving on to launch another school, bringing with them the experience 
and lessons learned in establishing the last one. The charter movement’s challenge is to 
replicate its best schools well and much faster than most older models. 

Several active schools of thought exist on what will best encourage the spread of more 
high-quality charter schools. With the exception of for-profit or non-profit orientations, 
these ideas are far from mutually exclusive: 

• Provide intensive technical assistance to individual school founders and charter 
authorizers. 

• Replicate successful schools via non-profit “charter management organizations” 
(CMOs). 

• Encourage for-profit education management organizations (EMOs) to run many 
schools in many locales. 
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• Invest in local and national infrastructure (new facilities, back office support, and 
the like) to simplify the task of running a school and eliminate the need for school 
leaders to be business and education experts. 

• Encourage new sources of school founders — religious organizations, community 
groups, and the like — to open and run charter schools. 

• Remove structural or political barriers to entry such as legislative caps, lack of 
appropriate buildings, or low per-pupil funding in order to attract more providers. 

Disagreements about which of these scale-up approaches merits the greatest invest- 
ment is causing significant disagreement within the charter school movement. This year 
in Chicago, national and local foundations put significant financial resources behind 
creating and supporting networks of school designs capable of replication. In doing so, 
they largely turned a deaf ear on arguments for a more “grassroots” approach of support- 
ing intensive technical assistance for people eager to launch individual schools. Similar 
investment decisions in California and other communities the previous year lead some 
to believe that the charter movement is moving away from its community-based origins, 
instead funding and promoting larger management organizations over “mom and pop” 
community-based schools. For example, in California a new organization, CharterVoice, 
was formed when the California Charter Schools Association took on a pro-growth 
orientation in order to “advocate on behalf of a diverse range of charter schools and the 
students they serve and . . . not support advocacy efforts that seek to limit the charter 
school movement to only specific types of charter schools .” 2 Others are deeply skeptical 
that the “management company” strategy can be a financially viable approach to scale, as 
most CMOs rely heavily on foundation funding to run their schools and most EMOs 
have yet to turn a profit . 3,4 

Reflecting this philosophical divide, several pioneering charter school support organi- 
zations have, in the past two years, lost funding support from the major foundations 
investing in charter schools. In most cases, these organizations are no longer in opera- 
tion. Technical assistance organizations in California, Washington, D.C., and Chicago 
all lost foundation support. An effort to create a national advocacy organization for 
charter schools had a false start when a more decentralized, membership-oriented 
version had its funding pulled. 

Taking their place are new entities, such as New Schools for Chicago, calling for faster 
growth and more consistent quality via “scalable” practices. Philanthropies supporting 
such organizations are placing a bet that the future of charter schools will look more like 



FIGURE 1: NEWSCHOOLS VENTURE FUND’S CHARTER SCHOOL GROWTH PROJECTIONS 
BY PROVIDER TYPE , 2002-2020 
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the one envisioned by networks of related schools and CMOs than the one envisioned 
by grassroots and community-based organizations. The NewSchools Venture Fund’s 
2004 projections for charter school growth under various start-up mechanisms are based 
on the assumption that the lion’s share of new charter growth between now and 2020 
will come from networks and CMOs, not network groups or profit-oriented EMOs. 

One consequence of this approach is that several major foundations investing in char- 
ters (e.g., the Bill and Melinda Gates, Pisces, and Walton Family Foundations) are 



Source: Adapted from 
Kim Smith , “How do 
we grow the movement 
and bring charters from 
the margins of public 
education? How much 
is enough growth ?” 
From Margins to 
Mainstream: Building a 
Stronger Charter School 
Movement (Washington 
D.C.: Progressive Policy 
Institute, 2003). 



increasingly offering replication grants to help “successful” schools expand the number 



of schools following their design or model. Foundation-funded efforts in 2003 and 



2004 included a $40 million-plus charter school accelerator run by NewSchools Venture 
Fund to help start new non-profit networks of charter schools. 5 Another $5.7 million 
gift to Aspire Public Schools from the Bill and Melinda Gates Foundation was said to 
be an endorsement of charter management organizations. According to the executive 
director of the Gates Foundation’s Educational Programs, Tom Vander Ark: “We have a 



better chance of seeing a much higher quality of school when schools are part of a net- 
work. You get a proven model.” 6 



What has failed to emerge from the feuding within the charter community is a sensible 
plan for empirical research and development. It is likely that no single strategy is suf- 
ficient and that a more empirical approach might help reveal how various approaches 
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could complement each other to leverage knowledge without sacrificing the energy and 
appeal of grassroots charter school advocates. 
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REPLICATING GREAT SCHOOLS IS NOT EASY 

To explore the potential for a more empirical research agenda, the National Charter 
School Research Project recently surveyed major profit and non-profit management 
organizations to document the lessons they are learning about replicating successful 
schools and the barriers they face. The survey revealed daunting challenges. Putting 
aside predictable complaints about unfriendly charter laws, unfair caps, and insufficient 
funding, the most serious barriers include: 

• deciding if and when the central organization should allow sites to adapt the 
model school’s culture and curriculum; 

• dealing with unstable political support, including hostility from once-friendly 
school boards, or supportive superintendents being replaced by hostile ones; 

• finding multiple sites in specific cities or neighborhoods to reach certain popula- 
tions, take advantage of favorable politics, or reduce costs; 

• developing or finding people skilled in network functions, not just running a suc- 
cessful school, who can create central technology infrastructure, recruiting and 
training systems, and provide real estate and other start-up services; and 

• finding and training school leaders and staff who believe in the model and can 
implement it successfully. 

The point is not that the replication strategy is flawed, but rather that every plausible 
scale-up strategy, including replication, faces significant barriers. 



DIVERSE APPROACHES TO SCALE CAN COMPLEMENT EACH OTHER 

Each of the theories of action to charter school scale described above has its own poten- 
tial strengths and weaknesses. The intensive technical assistance approach tries to build 
capacity of local school founders, but relies heavily on the assumptions that school 
founders will be plentiful and that stringent charter school oversight will be the main 
quality control mechanism. 




The CMO and EMO strategies attempt to spread effective school designs. They rely 
less on the independent inspired leader to invent a school design by providing the back- 
bone of a program along with needed technical assistance and management support. 
However, these programs inevitably lack the tight connection to the local context that 
can be achieved through grassroots development, while the non-profit models operate 
at a high per-pupil cost and have yet to prove themselves financially sustainable without 
foundation support. 

Strategies intended to build support infrastructure or remove barriers to entry aim to 
increase the supply of providers by lifting legislative caps, allowing more agencies to 
sponsor schools, and providing higher per-pupil funding and more facilities support. 
This approach makes it easier to start schools but provides no answer to provider supply 
or inside-the-school problems such as assuring quality instruction and finding capable 
leaders and staff. If uneven quality is the result, long-term political viability may be in 
jeopardy. 




Finally, “good people” theories, such as seeking out capable community leaders or train- 
ing new school leaders, can create new leaders, but perhaps not enough to meet large- 
scale needs. 



Table i outlines the various current theories of action for scaling-up quality charter 
schools. All of these methods are probably needed because they compensate for one 
another’s weaknesses . 7 



TABLE l: POTENTIAL COMPLEMENTARITIES AMONG CHARTER SCHOOL SCALE EFFORTS 



STRATEGY 




THEORY OF ACTION 


STRENGTHS 


WEAKNESSES 


Intensive technical assistance for 
aspiring school providers 


Help individual schools 
build capacity 


Taps support for local innovators; 
support for new ideas 


Slow and resource intensive; relies 
on authorizers for quality control 


EMOs, CMOs 


Develop and replicate effective 
school designs 


Private investment, scale 
economies, quality control, 
support networks 


Not highly adapted to local 
needs; target for political attacks; 
high central costs 


Back office and management support 


Free school leaders to focus on 
instruction 


Reduces financial and 
management problems, avoids 
scandal 


Enables but does not create new 
schooling options 


Pro-charter political advocacy 


Lower barriers to entry; 
fight opposition 


Buffers start-ups from hostile 
environment; lessens school 
leader burdens 


Enables but does not create new 
schooling options 


Charter-specific teacher 
recruitment and training 


Ensure that schools can tap a 
high-quality labor pool 


Reduces school start-up problems 
and need for early staff turnover 


Difficult to adapt recruitment 
and training to needs 
of diverse schools 
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MUCH IS KNOWN ABOUT SCALE-UP . . . 
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Advocates of charter school replication can learn from past efforts to bring public edu- 
cational programs or models to scale. A new book by the late Thomas Glennan and 
Susan Bodilly of RAND summarizes lessons from the world of education. They argue 
that there are no “silver bullets,” that replication requires building capacity to implement 
and sustain reform, while fostering a sense of ownership at the local level. The process 
of building reform and going to scale in schools is complex and iterative, according to 
Glennan and Bodilly. 

More relevant lessons for the charter movement may come from outside the public 
education experience, since charter schools operate outside the normal school district 
structure. The history of Catholic school networks shows how to construct limited, but 
effective, central office supports, design accountability systems appropriate to site-man- 
aged schools, and create strong mission-oriented school cultures . 8 

Efforts to replicate successful small businesses and non-profit entities demonstrate the 
need for realistic and sustainable business plans and strategies to ensure that the essen- 
tial elements that made the original entity effective are, in fact, identified and imitated . 9 
Catholic school admirers who focus on the practice of faith in these schools and the 
delegation of athletics to the Catholic Youth Organization are likely to miss central 
elements of what makes these schools work — top-down directives about curriculum, 
instruction, and the educational program allied with quite remarkable independence 
at the school level regarding finances, budget, tuition, and interaction with parents and 
community. 



... BUT WE NEED TO KNOW MORE 

Despite the existence of this information, scaling up of charter schools depends quite 
critically on improving our understanding of these processes. Better evidence on scale- 
up could help funders and policy makers understand how to: 

• accurately evaluate the impact, strengths, and weaknesses of different scale 
strategies; 

• strengthen various scale strategies so they result in the highest-quality schools; 




